Online Learning with Prior Knowledge
نویسندگان
چکیده
The standard so-called experts algorithms are methods for utilizing a given set of “experts” to make good choices in a sequential decision-making problem. In the standard setting of experts algorithms, the decision maker chooses repeatedly in the same “state” based on information about how the different experts would have performed if chosen to be followed. In this paper we seek to extend this framework by introducing state information. More precisely, we extend the framework by allowing an experts algorithm to rely on state information, namely, partial information about the cost function, which is revealed to the decision maker before the latter chooses an action. This extension is very natural in prediction problems. For illustration, an experts algorithm, which is supposed to predict whether the next day will be rainy, can be extended to predicting the same given the current temperature. We introduce new algorithms, which attain optimal performance in the new framework, and apply to more general settings than variants of regression that have been considered in the statistics literature.
منابع مشابه
The effect of language complexity and group size on knowledge construction: Implications for online learning
This study investigated the effect of language complexity and group size on knowledge construction in two online debates. Knowledge construction was assessed using Gunawardena et al.’s Interaction Analysis Model (1997). Language complexity was determined by dividing the number of unique words by total words. It refers to the lexical variation. The results showed that...
متن کاملHow Does Prior Knowledge Impact Students' Online Learning Behaviors?
This study explored the impact of prior domain knowledge on students’ strategies and use of digital resources during a Web-based learning task. Domain knowledge was measured using preand posttests of factual knowledge and knowledge application. Students utilized an ageand topic-relevant collection of 796 Web resources drawn from an existing educational digital library to revise essays that they...
متن کاملA Q-learning Based Continuous Tuning of Fuzzy Wall Tracking
A simple easy to implement algorithm is proposed to address wall tracking task of an autonomous robot. The robot should navigate in unknown environments, find the nearest wall, and track it solely based on locally sensed data. The proposed method benefits from coupling fuzzy logic and Q-learning to meet requirements of autonomous navigations. Fuzzy if-then rules provide a reliable decision maki...
متن کاملComfort and experience with online learning: trends over nine years and associations with knowledge
BACKGROUND Some evidence suggests that attitude toward computer-based instruction is an important determinant of success in online learning. We sought to determine how comfort using computers and perceptions of prior online learning experiences have changed over the past decade, and how these associate with learning outcomes. METHODS Each year from 2003-2011 we conducted a prospective trial o...
متن کاملOnline-learning: exploring practices among Foundation doctors
Introduction: Postgraduate medical education involves the use ofonline-learning tools. However, there is a paucity of data on theuse of online-learning among doctors who are in their 1st and 2ndyears of professional work after graduating from medical school(also known as Foundation doctors). Our aim was to explore theuse of online-learning among Foundation doctors.Methods: A cross-sectional stu...
متن کاملAn Online Q-learning Based Multi-Agent LFC for a Multi-Area Multi-Source Power System Including Distributed Energy Resources
This paper presents an online two-stage Q-learning based multi-agent (MA) controller for load frequency control (LFC) in an interconnected multi-area multi-source power system integrated with distributed energy resources (DERs). The proposed control strategy consists of two stages. The first stage is employed a PID controller which its parameters are designed using sine cosine optimization (SCO...
متن کامل